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Abstract 

In  this  paper  we  formulate  and  study  an  interesting  (sub) optimal  iioo  con¬ 
trol  problem  related  to  the  attenuation  of  impulsive  disturbances  to  a  class 
of  linear  systems.  Among  the  motivating  factors  is  the  need  to  study  control 
problems  related  to  mechanical  systems  subject  to  impulsive  forces,  e.g.  ac¬ 
tive  control  of  the  suspension  system  of  a  vehicle,  accurate  pointing  of  guns, 
stabilization  of  an  antenna  on  the  space  station  subject  to  impact  from  space 
debris,  or  active  damping  of  vibrations  of  flexible  structures  caused  by  impact 
forces  [1,  2].  A  reasonable  control  objective  in  all  these  problems  is  to  design 
a  stabilizing  controller  to  minimize  the  induced  operator  norm  from  the  impul¬ 
sive  disturbances  to  the  controlled  outputs.  We  derive  necessary  and  sufficient 
conditions  for  the  existence  of  a  (sub)optimal  controller,  and  give  a  procedure 
to  compute  such  a  controller  when  one  exists. 


1  Introduction 

An  important  paradigm  in  control  synthesis  is  the  H0 0  control  problem,  introduced 
by  Zames  [3].  In  this  formulation  disturbances  are  assumed  to  belong  to  a  ball  in 
a  certain  function  space,  and  control  inputs  are  computed  in  order  to  minimize  a 
quadratic  cost  function  assuming  that  the  disturbances  are  worst  possible.  Various 
theories  of  control  problems  have  been  developed  by  many  researches  [4,  5, 
6,  7,  8,  9]  and  procedures  for  solving  them  have  been  given  via  frequency  domain 
methods  and  more  recently,  using  state-space  methods.  In  this  paper,  we  consider 
a  (sub)optimal  control  problem  for  the  attenuation  of  dynamical  effects  due  to 
an  impulsive  disturbance.  Motivation  for  this  arises  from  the  need  to  study  control 

‘This  research  was  supported  in  part  by  the  AFOSR  University  Research  Initiative  program 
under  grant  AFOSR-90-0105,  by  the  NSF  Engineering  Research  Center  Program:  NSFD  CDR 
8803012,  by  ARO  University  Research  Initiative  under  Grant  DAALO3-92-G-0121,  and  by  NSF 
Grant  ECE  9096121. 
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problems  related  to  mechanical  systems  subject  to  impulsive  forces,  e.g.  active 
control  of  the  suspension  system  of  a  vehicle,  accurate  pointing  of  guns,  stabilization 
of  an  antenna  on  the  space  station  subject  to  impact  from  space  debris,  or  active 
damping  of  vibrations  of  flexible  structures  caused  by  impact  forces.  A  reasonable 
control  objective  in  all  these  problems  is  to  design  a  stabilizing  controller  to  minimize 
the  induced  operator  norm  from  the  impulsive  disturbance  to  the  controlled  output. 
Our  approach  is  based  on  the  state-space  methodflO].  Impulsive  disturbance  is 
denoted  by  vq  and  is  assumed  to  live  in  the  l2  space.  The  controlled  output  is 
denoted  by  z.  Our  goals  are  (1)  to  give  necessary  and  sufficient  conditions  for  the 
existence  of  a  stabilizing  controller  such  that  )|^||z,2  <  7IN||j2  f°r  all  vo  ^  0  and  a 
given  7,  and  (2)  to  give  a  procedure  to  compute  such  a  controller  when  one  exists. 


2  Formulation  of  Control  Problem 


In  this  section,  the  control  problem  is  formulated  with  the  specification  of  system 
dynamics,  performance  index,  and  general  assumptions.  Let  l2  denote  the  Hilbert 
space  of  square-summable  complex- valued  sequences  {xk,k  >  0}  with  the  norm 
defined  as 

00 

11*11/,  :=  C£  M2)1'2.  (2.1) 

fc=0 

Let  L2  denotes  the  Hilbert  space  of  all  complex-valued  Lebesque  measurable  func¬ 
tions  x(t)  defined  on  the  [0,  oo)  with  the  property  that  \x\2  is  Lebesque  integrable. 
The  norm 

roc 

MUa:=(jf  \\x{t)\\2dt)112.  (2.2) 

We  consider  a  finite-dimensional  linear  system 


z  _  Ail  A12  vo 

y  L2i  L22  u 


(2.3) 


where  z(t),y(t)  are  controlled  and  measured  output  vector,  respectively.  They  are 
piecewise-continuous  signals.  There  are  two  kinds  of  input  signals,  u  the  control 
vector  which  is  assumed  to  be  piecewise-continuous,  and  vo  the  impulsive  distur¬ 
bance  vector  which  is  assumed  to  be  in  the  l2  space.  =  1,2  are  the  linear 

operators  mapping  from  {uo5w}  to  {z,  y}.  This  is  a  hybrid  system  since  it  contains 
both  continuous  time  and  discrete  time  components.  We  assume  that  the  system 
(2.3)  admits  a  state  space  realization  of  the  form: 

00 

x(t)  =  Ax(t)  +  ^2  B2v0{i)5(t  -  iTi)  -)-  Biu(t), 

i=0 

z(t)  =  C\x(t)  +  D\u{t), 

y{t)  =  C2x{t),  (2.4) 
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where  x(t)  are  n  x  1  state  variables.  A,  B\,  B2,  C\,  C2,  D 1  are  constant  matrices  with 
proper  dimensions.  Tj  is  the  interval  between  the  (i  —  l)th  and  ith  impulses.  In  the 
rest  of  this  paper,  we  assume  that  this  time  interval  is  constant,  i.e.,  Tt  =  T,  i  = 

0,1,2, . .  The  S(t)  is  the  standard  Dirac  Delta  distribution.  It  is  easy  to  see 

that  the  effect  of  impulsive  disturbances  is  to  cause  possible  jumps  of  state  variables. 
For  convenience,  the  state  space  equations  (2.4)  can  be  put  into  the  following  form 
also: 


x(t) 

=  Ax(t)  +  Biu(t),  t  7^  iT, 

x{t+) 

=  x(t)  +  Bivoii),  t  =  iT ,  i  =  0,1,2, . , 

z(t ) 

=  Cix(t)  +  D\u{t) 

y(t) 

=  C2x(t) 

(2.5) 

where  x(t+)  denote  the  values  of  state  variables  after  jump.  The  state  variables  x(t) 
are  right  continuous  and  may  be  left  discontinuous  due  to  the  possible  jump. 


The  control  problem  here  is  to  design  a  stablilizing  controller  to  attenuate  effects 
of  the  impulsive  disturbance  vq  on  the  controlled  output  2.  This  problem  can  be 
studied  in  the  /Too  control  framework  [3,  4,  5].  The  solution  for  a  special  case  of  this 
problem  by  frequency-domain  methods  is  given  in  [11].  Let  us  define  K  as  the  set 
of  all  causal,  finite-dimension  linear  stabilizing  controllers. 


We  will  now  introduce  a  minimax  performance  measure  which  is  motivated  by  [10]. 
For  k  €  K  define  a  performance  measure, 


Ak)  = 


sup  ( 


I2 

\l2 


voEh^o^O  |M|,2 


)• 


(2.6) 


J(k )  can  also  be  viewed  as  the  induced  norm  of  the  linear  operator  from  / 2  — »  L^- 
The  control  objective  is  to  find  a  controller  k  G  K  to  minimize  the  worst  case  per¬ 
formance  measure  J(k).  Specifically,  we  solve  the  following  (sub)optimal  problem. 
Given  a  real  7  >  0,  try  to  find  a  k  €  K  such  that  following  inequality  holds, 

J(k)  <  72  (2.7) 


or  equivalently, 

I  MIL  -t2IMI?2  <  0,  (2.8) 

for  all  possible  vq  €  I2,  under  the  constraints  of  system  equations  (2.5).  If  such  a 
controller  k  exists,  we  call  it  a  7— level  disturbance  attenuation  controller. 
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3  Main  Results 

We  start  with  a  standard  H <*,  control  problem  treated  in  [5,  6]  where  we  consider  a 
continuous  LTI  system.  It  is  well  known  that  a  state-space  solution  of  H ^  control 
is  closely  related  to  the  Riccati  equations.  If  full  state-feedback  is  available,  a  con¬ 
troller  exists  iff  the  unique  solution  of  the  associated  algebraic  Riccati  equation  is 
positive  definite.  In  addition,  a  formula  for  the  state-feedback  gain  matrix  was  given 
in  terms  of  the  solution  of  the  Riccati  equation.  Similar  results  can  be  obtained  for 
discrete-time  systems  [8]  and  time-varying  systems[12]. 

It  should  be  noted  that  the  control  problem  defined  in  (2.8)  is  different  from  the 
standard  H<x>  problems  treated  in  [5,  6]  or  [8, 12].  The  system  (2.5)  is  a  hybrid  system 
which  contains  both  continuous  and  discrete  components,  the  formulas  obtained  in 
[5,  6,  8,  12]  can  not  be  applied  to  this  problem,  but  the  essential  ideas  can  be  carried 
over  to  analyze  the  control  problem  (2.8).  For  state-feedback  control,  instead  of  one 
algebric  Riccati  equation  involved  in  problems  [5,  6],  we  will  have  two  coupled  Riccati 
equations  given  by 

K(t)  =  - A'K(t )  -  K(t)A  +  K{t)BxB[K{t)  -  C[Ci,  t  ^  iT  (3.1) 
K(iT+)  =  K^  +  iB'iKiiT))'^2! -B'2K{iT)B2)-lB'2K{iT)  (3.2) 

where  7  >  0  is  a  given  real  number  and  T  >  0  is  the  time  interval  between  each 
jump.  The  n  x  n  matrix- valued  function  K(t)  is  right  continuous  and  may  be  left 
discontinuous.  We  use  K(iT)  to  represent  the  value  of  K(t)  just  before  the  ith  jump, 
i.e.,  K(iT )  :=  lim£>o,£->o  K(iT  —  e)  assuming  that  the  limit  exists. 

We  state  the  our  main  results  as  Theorems  3. 1-3.3. 

We  assume  that  all  state  variables  are  measured.  We  consider  the  infinite  horizon 
problem  with  zero  initial  state.  First  the  following  standard  assumptions  are  made. 

i)  (A,  B\ )  is  controllable,  {C\ ,  A)  is  observable. 

ii)  D[[Ci  D\]  =  [0  /]. 

Assumption  i)  is  standard  in  the  quadratic  regulator  of  linear  system.  It  can  be 
relaxed  by  the  assumption  that  (A,  B{)  is  stabilizable  and  (Cj,  A)  is  detectable. 
Assumption  ii)  is  made  here  just  for  the  sake  of  simplicity.  Relaxing  this  assumption 
will  only  complicate  the  formulas,  but  an  analysis  can  be  carried  out  along  lines 
similar  to  what  appears  below. 

Theorem  3.1  Consider  the  hybrid  system  described  by  (2.5).  Let  7  >  0  be  given. 
Suppose  that  the  assumptions  i)  and  ii)  hold.  Then  there  exists  a  stabilizing  con¬ 
troller  k  <E  K  such  that  J(k)  <  j2  if  there  exists  a  unique  stabilizing  positive  definite 
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periodic  solution  P(t)  of  the  coupled  Riccati  equations  (3.1)-(3.2).  Moreover ,  if  this 
condition  is  satisfied,  one  such  stabilizing  state-feedback  controller  is  given  by 

u{t )  =  -B[P{t)x{t),  Vi  >  0.  (3.3) 

□ 


Remark  3.1  As  7  — >  00,  the  equations  (3.1)- (3. 2)  degenerate  into  a  continuous¬ 
time  Riccati  equation, 

K(t)  =  -A!K(t)- KlfiA  +  K^BxB'^K^-C'xCi,  (3.4) 

This  Riccati  equation  will  yield  a  unique  postive  definite  constant  matrix  solution 
under  the  assumption  i).  The  unique  solution  internally  stabilizes  the  associated 
closed-loop  system  by  the  standard  LQG  theory.  Thus,  the  problem  degenerates 
into  a  LQG  problem  as  7  — >  00. 


A  very  useful  tool  to  analyze  the  Riccati  equations  is  the  Hamiltonian  theory,  this 
solution  of  a  Riccati  equation  can  be  obtained  by  solving  a  suitable  set  of  linear 
differential  equations.  The  Hamiltonian  matrix  associated  with  continuous  time 
Riccati  equation  (3.1)  is  given  by 


A  -BXB[ 

~  [  -C[Ci  -A'  ’ 

As  usual  let  us  consider  a  2n  order  differential  equation, 

X(t)  =  HX(t),  t^iT. 


The  state  transition  matrix  associated  with  H  is 


(3.5) 


(3.6) 


X(t)  =  4>#(t,  t)X(t),  t>r,  and  t,r^iT,  (3.7) 

where  4>#(t,  r)  has  the  following  properties, 

d*HftT)  =  HQH(t,T),  $h(t,t)=I.  (3.8) 

The  symplectic  matrix  associated  with  difference  Riccati  equation  (3.2)  is  given  by 


I  —7  ~2B2B'2 
0  I 


(3.9) 


Let  us  define  a  2n  order  difference  (jump)  equation  as  follows, 

X(t+)  =  FX  (t) ,  t  =  iT.  (3.10) 
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The  combined  equations  (3.6)  and  (3.10)  is  a  hybrid  system.  For  r  =  iT,  i  = 
0, 1,  ,  and  t  <t  <(i  +  1)T,  we  have, 

X(t)  =  *H(t,T)FX(r), 

=  $(t,T)X(T).  (3.11) 

We  will  show  later  that  this  state  transition  matrix  3>(i,  r)  of  the  hybrid  system 
displays  same  properties  familiar  with  a  periodic  system. 

Now,  let  P(t)  be  a  periodic  solution  of  equations  (3.1)-(3.2).  We  will  study  the 
associated  closed-loop  system, 

x(t)  =  [A  -  BiB[P(t)]x{t).  (3.12) 

Definition  3.1  A  periodic  solution  P(t)  of  (3.1)-(3.2)  is  called  a  stabilizing  solution 
if  the  closed-loop  system  (3.12)  is  asymptotically  stable. 

Let  us  consider  the  following  hybrid  system  first, 


x(t)  =  [A-  BiSiP(t)]a(i), 

—  -A-dt),  t  ^  iT, 

(3.13) 

x(t+ )  =  [I-r2B2B'2P(t)\x(t), 

=  Fc(t),  t  -  iT. 

(3.14) 

It  is  easy  to  see  that  this  hybrid  system  is  actually  the  closed-loop  system  for  an  im¬ 
pulsive  disturbance  generated  by  state-feedback.  Thus,  the  asymptotically  stability 
of  this  hybrid  system  provides  a  necessary  condition  for  asymptotically  stabilizing 
of  closed-loop  system  (3.12). 

Theorem  3.2  Let  7  >  0  be  given.  Suppose  that  the  assumptions  i)  and  ii)  hold. 
Then  a  necessary  and  sufficient  condition  for  the  existence  of  a  unique  positive 
definite  periodic  solution  P(t)  to  equations  (3.1)  -  (3.2)  such  that  the  hybrid  system 
(3.13)-(3.1Jt)  is  asymptotically  stable  is  that  no  eigenvalue  of  $(T,  0)  lies  on  the  unit 
circle.  □ 

The  next  theorem  gives  necessary  and  sufficient  conditions  that  the  unique  positive 
definite  periodic  solution  stabilizes  the  associated  closed-loop  system. 

Theorem  3.3  Suppose  that  the  assumptions  i )  and  ii)  hold.  Let  P(t)  be  the  unique 
positive  definite  periodic  solution  of  (3.1)  and  (3.2).  Then  P(t)  is  a  stabilizing 
solution  iff  the  following  inequality  holds, 

WC(T)  -  $'Ac (T ,  0)Qtmp (T)$Ac(T,  0)  >  0  (3.15) 
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where, 


WC(T)  =  /T$Ac(r,0),F(r),if(r)$Ac(T,0)dr  (3.16) 

Jo 

and  $Ac(i, r)  is  state  transition  matrix  of  Ac{t).  The  matrices  Ac(t),H(t)  and 
Qtmp(T)  are  defined  by 

Ac(t)  =  A  —  B\B[P{t), 

H(t)'H(t)  =  C[C\  +  P(t)BiB[P(t), 

QtmP(T )  =  (B'2P(T))' (j2 1  -  B'2P{T)B2)-lB'2P{T).  (3.17) 

□ 


4  Background  and  Technical  Lemmas 

In  order  to  prove  Theorems  3. 1-3.3,  we  need  to  develop  theory  and  technical  ma¬ 
chinery  to  analyze  the  coupled  Riccati  equations  (3.1)  and  (3.2).  Specifically,  1)  we 
will  give  conditions  for  existence  of  periodic  solutions  of  equations  (3.1)  and  (3.2), 
2)  If  such  conditions  are  satisfied,  we  will  parametrize  all  stabilizing  periodic  solu¬ 
tions.  The  technical  machinery  is  built  here  based  on  the  analysis  of  the  standard 
periodic  systems  [13,  14,  15].  We  will  show  that  equations  (3.1)  and  (3.2)  display 
same  properties  familar  with  a  standard  periodic  system,  the  main  difference  being 
that  we  need  to  take  care  of  the  jumps  in  the  state  which  actually  result  in  the 
periodic  solutions.  For  the  sake  of  simplicity,  we  are  not  going  to  give  all  proofs  to 
the  lemmas  and  theorems  developed  in  this  section.  The  complete  proofs  can  be 
found  in  [16]  and  similar  proofs  for  a  standard  periodic  system  can  be  found  in  [13]. 


Let  $(t,  t)  defined  in  (3.11)  be  partitioned  into  four  nx  n  matrices  as  follows, 


$(t,r)  = 


$h(<,t)  $12  (t,r) 

$21  (t,r)  $22  {t,r) 


It  is  easy  to  show  that  $(t,  t)  has  the  property  for  all  t  and  r, 

$(t  +  T,r  +  T)  =  $(f,r). 

Lemma  4.1  The  eigenvalues  of  $(f  +  T,  t)  are  independent  of  t. 


Proof:  Without  loss  generality,  we  assume  t  6  (0,  T).  By  definition, 

$(t  +  T,t)  =  <f>H(t  +  T,T+)F$H(T,t) 

=  $ffM+)F$F(T,i) 

=  $^1(T,t)$H(T,0+)F$i/(T,f) 

=  $tf1(T,f)$(T,0)$*(T,t). 

Thus,  the  eigenvalues  of  $(t  +  T,  t)  are  independent  of  t.  □ 
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The  hybrid  state  transition  matrix  4>(t  +  T,  f)  displays  same  properties  familiar  with 
periodic  systems.  Hence  we  may  expect  that  there  exists  a  periodic  solution  of 
equations  (3.1)-(3.2).  For  simplicity,  we  will  assume  that  the  matrix  4>(T,  0)  has 
distinct  eigenvalues.  Let  A  be  the  corresponding  diagonal  Jordan  form  such  that 

5_1(0)$(T,  0)5(0)  =  A,  (4.3) 


where  the  matrix  5(0)  is  composed  of  eigenvectors  of  4>(T,  0).  It  should  be  noted 
that  the  derivation  of  results  can  be  applied  to  the  case  of  multiple  eigenvalues  with 
minor  modifications.  Now  partition  5(0)  into  four  n  x  n  matrices 


5(0) 


no)  no) 

*(0)  U{  0) 


(4.4) 


and  partition  A  similarly.  Then  equation  (4.3)  can  be  written  as, 


'$n(T,0)  *i2(T,0)  ' 

'  y(o)  7(0) ' 

'  7(0)  7(0)  ' 

’  Ai  0 

<MT,0)  <MT,0) 

X(0)  17(0)  _ 

A(0)  17(0)  _ 

0  a2 

where  Ai  is  an  n  x  n  diagonal  matrix, 


(4.5) 


Ai  =  diag{\i, . ,An} 


(4.6) 


and  {Ai , . ,  Art}  are  n  of  the  2n  eigenvalues  of  4>(T,  0).  Let  us  define  a  2n  x  2n 

matrix  5(f )  for  t  >  0  by 


5(f)  =  $(t,  0)5(0). 
Again,  partition  5(f)  as  follows, 


5(f)  = 


Y(t )  7(f) 
X{t)  U(t) 


Lemma  4.2  The  equation  $(t  +  T,  t)5(t)  =  5(f) A  holds  for  all  t  >  0. 
It  is  easy  to  show  that  the  following  equation  also  holds, 
dS(t) 


(4.7) 

(4.8) 

□ 


dt  =  HS(t),  t^iT, 

5(t+)  =  FS(t),  t  =  iT,i  =  0,1,2, . , 


Theorem  4.1  Let  A  he  an  eigenvalue  of  $(t,r)  and 

eigenvector.  Then  A-1  is  also  an  eigenvalue  o/$(t,  t)  and 
o/4>(t,  t)'  associated  with  A-1. 


V 

x 


y 


(4.9) 

he  the  corresponding 

is  the  eigenvector 

□ 
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4.1  Parameterization  of  periodic  solution  with  jumps 

The  following  theorem  gives  a  parameterization  of  all  periodic  solutions  of  equations 
(3.1)-(3.2)  in  terms  of  X(t)  and  Y(t)  defined  in  equation  (4.8). 

Theorem  4.2  Suppose  Y(t)  defined  in  equation  (4-8)  is  non-singular  for  all  t  G 
[0,T].  Then  P(t)  given  by 

P(t)  =  X(t)Y(t)-\  t>  0  (4.10) 

is  a  periodic  solution  of  equation  (3.1)  and  (3.2). 

Proof; 


Therefore, 


S(t  +  T)  =  $(i  +  T,  0)5(0) 

=  $(t  +  T,t)$(t,  0)5(0) 

=  S(t)  A. 


'  Y(t  +  T) 
X(t  +  T) 


Y(t) 

X(t) 


Ax,  t>0. 


(4.11) 


P(t)  =  X^Yit)-1  -  XWYity'YitjYit)-1 

=  [~C[CiY(t)  -  AX{t)]Y(t)~l  -  X{t)Y{t)~l 
[AY {t)  -  BxB[X{t))Y{t)-1 
=  —A'P(t)  -  P(t)A  +  P(t)BiB[P(t)  -  C[Ci 

p{  o+)  =  x(o+)r(o+)_1 

=  X(0)[Y(0)--y-2B2B'2X(0)}-1 

=  P(0)[/-T-2B2B^(0)]-1  (4.12) 

It  is  easy  to  show  that  P(0+)  satisfies  equation  (3.2).  Thus  P(t )  in  equation  (4-10) 
satisfies  equations  (3.1)  and  (3.2).  It  is  periodic  since  from  (4-11), 

P(t  +  T)  =  X(t  +  T)Y(t  +  T)~l  =X(t)Ai[F(t)Ai]-1  =  P(t).  (4.13) 

□ 

Remark  4.1  It  is  obvious  that  periodic  solution  is  generated  by  jump  terms.  If 
7  — >  oo,  the  jump  terms  vanish  and  P(t)  will  degenerate  into  a  constant  matrix 
solution. 


9 


4.2  Analysis  of  periodic  solutions  with  jumps 

The  following  Lemmas(4.3)-(4.6)  characterize  the  properties  of  a  solution  P(t)  that 
depend  on  the  choice  of  n  eigenvalues  Ai, . Xn  for  Ai.  Let 

n{t)  =  Y(t)*X(t),  (4.14) 

Cl(t)  =  Y(t)'X(t),  (4.15) 

where  *  is  used  to  denote  the  complex  conjugate  transpose.  Suppose  \Y(t)\  0  for 

all  t  6  [0,T],  P(t)  can  be  rewritten  as, 

P(t)  =  X(t)Y(t)~l 

=  (Yitr'ymYit)-1 

=  (y(t)_1)'n(t)y(i)-1-  (4.16) 

Lemma  4.3  If  X*  7^  Xj  1  for  all  i,j ,  1  <  i,j  <  n,  then  0(f)  is  Hermitian  and  real. 
□ 

Lemma  4.4  If  |Aj|  <  1  for  all  i  =  1,2, . n,  then  0(f)  is  positive  definite.  □ 

Lemma  4.5  Assume  that  |T(t)|  ^  0  for  all  t  e  [0,T].  If  Af  ^  AJ1  and  A;  ^  Xj 1 
for  all  i,j,  1  <  i,  j  <  n,  then  P(t)  defined  by  equation  (4-10)  is  real.  □ 

Theorem  4.3  Assume  that  for  all  eigenvalues  o/$(T,  0),  |Aj|  ^  1,  i  =  1, 2 . 2n 

and  that  |T(f)|  /  0  for  all  t  €  [0,T].  If  n  eigenvalues  in  Ai  are  chosen  such  that 

| A^  |  <  1, »  =  1,2 . n,  then  a  periodic  solution  P(t)  given  by  equation  ( 4.10 )  is 

real,  symmetric  and  positive  definite. 

Proof:  The  assumption  |Aj|  <  1  for  all  i  =  1,2 . n  guarantees  that  X*  ^  A”1 

and  X i  7^  Xj  for  all  i,j,  1  <  i,j  <  n.  Therefore  P(t)  is  real  and  symmetric  by 
Lemmas  (4-3)  and  (4-5)  respectively.  That  P(t)  is  positive  definite  follows  from 
Lemma  (4-4)  and  equation  (4-16).  □ 

4.3  The  Periodic  Lyapunov  Equation 

Our  approach  for  the  analysis  of  the  closed-loop  system  (3.12)  is  based  on  the  Lya¬ 
punov  method.  As  is  well-known,  the  Lyapunov  equation  plays  an  important  role 
in  the  analysis  of  Riccati  equations  and  the  associated  closed-loop  systems.  Here 
we  extend  some  useful  results  on  the  periodic  Lyapunov  equation  to  our  particular 
problem,  namely,  to  the  periodic  Lyapunov  equation  with  jumps. 

Let  P(t)  be  a  solution  of  the  coupled  Riccati  equations  (3.1)-(3.2), 

P{t)  =  - A’P{t )  -  P(t)A  +  P{t)B\B[P(t)  -  C[Ci,  t  /  iT  (4.17) 

P(iT+ )  -  P(iT)  +  (B'2P(iT)),(j‘2I-B,2P(iT)B2)-1Bl2P(iT).  (4.18) 
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It  can  be  rewritten  as  a  Lyapunov-type  equation, 

P(t)  =  —Ac(t)'P(t)  -  P(t)Ac(t)  -  t  ±  iT  (4.19) 

P(iT+ )  =  P(iT)  +  Qtmp(iT).  (4.20) 

where  Ac(t),H(t )  and  Qtmp(?T)  are  given  in  (3.17).  Therefore,  we  can  obtain  the 
following  results  from  [17,  18].  If  P(-)  is  a  symmetric  periodic  solution  of  the  Riccati 
equation  (4.17)-(4.18),  then  P(-)  is  also  a  solution  of  the  Lyapunov  equation  (4.19)- 
(4.20).  The  structural  properties  of  the  pair  (H(t),Ac(t))  can  be  related  to  the  ones 
of  the  pair  ( C\,A )  by  means  of  the  following  Lemma  [18,  19]. 

Lemma  4.6  The  pair  {C\,  A)  is  observable  iff,  for  any  T— periodic  matrix  P(-),  the 
pair  (H(t),  Ac(t))  is  observable.  □ 

The  solution  of  equations  (4.19)-(4.20)  is  given  by  the  celebrated  formula  [20].  Let 
Po  be  the  initial  condition  of  equation  (4.19)  at  time  to,  the  solution  of  the  equation 
(4.19)  is  given  by 

P(t)  =  &Ac(to,t)P0$Ac(t0,t)  ~  f  &Ac(T,t)H(T)'H(T)$'Ac(T,t)dT.  (4.21) 

Jto 

Without  loss  of  generality,  we  assume  to  =  0,  then  P(T)  is  given  by 

P(T)  =  $'Ac (T,  0)~1Po$J4c (T,  0)_1  -  fT  &Ao(T,T)H(T)'H(T)&Ac(T,T)dT.  (4.22) 

J  0 

Since  we  are  looking  for  the  periodic  solutions  of  equations  (4.19)-(4.20),  the  periodic 
generator  Po  must  satisfy  the  following  algebraic  Lyapunov  equation 

Po  =  $'Ac(T,  0)P0$Ac(T,0)  +  W(T)  (4.23) 

where  the  W  ( T )  is  given  by 

W(T)  =  WC(T)  -  &Ac(T,0)Qtmp(T)$Ac(T,0).  (4.24) 

Proposition  4.1  [21]  The  Lyapunov  equations  (4-19)-(4.20)  admit  a  unique  pos¬ 
itive  periodic  solution  iff  the  algebraic  Lyapunov  equation  (4-23)  admits  a  positive 
definite  solution  Pq.  □ 

Proposition  4.2  Suppose  that  the  Ac(t)  is  asymptotically  stable.  Then  the  nec¬ 
essary  condition  that  algebraic  Lyapunov  equation  (4-23)  admits  a  positive  definite 
solution  is  that  W (T)  defined  in  (4-24)  is  positive  definite.  □ 

5  Proofs  of  Theorem  3. 1-3. 3 

Now,  we  are  ready  to  prove  the  main  results  of  this  paper.  First  we  prove  the 
Theorem  3.2,  then  we  prove  the  Theorem  3.3.  Finally,  we  consider  the  Theorem 
3.1. 
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5.1  Theorem  3.2 

Recall  the  hybrid  system  defined  in  (3.13)-(3.14), 


x(t)  =  [A  —  BiB[P(t)]x(t), 

=  Ac(t),  t  iT , 

(5.1) 

(t+)  =  [I-'y-2B2B'2P(t)\x(t), 

-  Fc(t),  t  =  iT. 

(5.2) 

Denote  the  state  transition  matrix  of  the  hybrid  system  (5.1)  -(5.2)  by  4>c(t,  r).  It 
has  the  following  properties, 

--^t—  =  Acmc(t,r),  (5.3) 

$c(t+,t)  -  Fc(t).  (5.4) 

Theorem  5.1  Let  P(t )  in  equation(4-10)  be  substituted  into  equation  (5.1)  and 

(5.2).  Also  let  Xi,i  =  1,2, . n  be  n  eigenvalues  o/4>(T,  0)  used  to  form  in 

equation (4 -6),  then  4>c(t,  0)  is  given  by 

*cM)  =  ^WT(O)-1  (5.5) 

and  the  eigenvalues  o/4>c(T,  0)  are  Xi,i  =  1,2, . n. 

Proof;  Using  equation  (4-9),  we  have 


*eM) 

=  r(i)T(0)_1 

=  [AY(t)  -  BiB[X (t)]Y (0)~l 
=  [A-B&Pit)]*  c(t,0) 

=  Ac(*)$c(t,0). 

(5.6) 

$c(0+,0) 

=  y(o+)y(o)-1 

=  [Y(0)-7-2B2B'2X(0)}Y(0)-1 

=  [I  —  ■y~2B2B2P(0)] 

=  Fc( 0). 

(5.7) 

From  equation  (4-11), 

Y(T ) 
*c(T,  0) 

=  T(0)Ax 

=  y(r)y(o)-1  =  y(o)Aiy(o)-1. 

(5.8) 

Thus,  eigenvalues  o/<J>c(T,  0) 

are  X i,i  =  1, 2,  . . n. 

□ 
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The  following  lemmas  relate  the  positive  definite  periodic  solution  of  the  coupled 
Riccati  equations  and  the  structure  properties  of  systems  (controllability  and  ob¬ 
servability)  . 

Lemma  5.1  [16]  Assume  (A,  B\)  is  controllable.  A  necessary  and  sufficient  condi¬ 
tion  for  the  existence  of  a  positive  definite  periodic  solution  P(t)  to  equations  (3.1) 
-  (3.2)  such  that  the  hybrid  system  (5.1)-(5.2)  is  asymptotically  stable  is  that  no 
eigenvalue  o/<3>(T,  0)  lies  on  the  unit  circle.  □ 

Lemma  5.2  [16]  Assume  that  no  eigenvalue  o/$(T,  0)  lies  on  the  unit  circle  and 
(A,  By)  is  controllable.  Then  there  exists  a  unique  positive  definite  periodic  solution 
P(t)  to  equations  (3.1)-(3.2)  if(C\,A)  is  observable.  □ 

Proof  of  Theorem  3.2:  It  follows  immediately  from  the  Theorem  5.1  and  Lemmas 
5. 1-5. 2. 

5.2  Theorem  3.3 
(Sufficient  condition): 

Consider  the  following  Lyapunov  function  candidate, 

V(t)  =  x(t)'P(t)x(t).  (5.9) 

Since  P(t)  =  P(t)'  >  0,  then  V(t)  is  positive  definite.  P(t)  is  a  periodic  function 
with  jumps,  so  is  the  function  V{t).  Hence  we  need  to  show  that  V (i)  is  monotone 
decreasing,  i,e., 

V'(ii)  -  V{t2)  <0,  h  <  <2,  \/tut2.  (5.10) 

We  consider  two  cases: 

(1)  t  7^  iT,  differentiate  V(t)  along  the  trajectory  of  system  (3.12), 

V(t)  =  x(t)'P(t)x(t)  +  x(t)'P(t)x(t)  +  x(t)’P(t)x(t) 

=  x(t)'(P(t)  +  Ac(t)'P(t)  +  P(t)Ac(t))x(t) 

=  - x(t)'H{t)'H(t)x{t )  (5-11) 

<  0. 

Hence  inequality  holds  for  all  t\,t2  ^  iT. 

(2)  t  =  iT,i  =  0, 1, 2, . .  In  the  rest  of  proof,  we  use  i  to  replace  iT  for  the  sake 

of  brevity.  Since  V(t)  =  -x{t)'H(t)'H(t)x(t)  <  0, 

V(i )  =  V{(i  —  1)+)  —  /  x(t  )'  H  (t  y  H(t  )x(r)dT 

Ji- 1 

V(i+ )  =  x(i)' P(i+)x(i) 

x(i)  P(i)x(i)  x(i )  Qtmp(i)x(i) 

P(i)  +  x(i)  Qtmp(i)x{i).  (5.12) 
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Hence 


V(i+)-V((i-l)+)  =  x(iYQtmp{i)x{i)-  [  x{t)' H{t)' H(t)x(t)<It.  (5.13) 

Ji- 1 

iProm  equation  (3.12),  we  can  explicitly  solve  x(t)  starting  at  arbitrary  x(i  —  1), 
x(t)  =  $Ac(t,i  -  1  )x(i  -  1),  Vt  G  [(*  -  1),  *].  (5.14) 

Replace  x(t)  in  equation  (5.13)  by  (5.14), 

V(i+)  -  V((i  -  1)+) 

=  *(*'  -  -  1  )Qtmp{i)$Ac{i,i  -  1) 

-[  ®'ac(tP  -  l)H(.T)'H(T)$Ac(T,i  -  l)dr}x(i  -  1).  (5.15) 

Ji—  1 

Since  Ac(t) , H (t)' H (f)  and  Qtmp{i)  are  periodic,  <&Ac(i,i  -  1)  =  4>ac(T,0),  and 

Qtmp(T )  =  Qtmp{T)  for  all  t  =  0,1,2, . .  The  equation  (5.15)  can  be  further 

simplified  as 

y(i+)-T((i-l)+)  =  x(i  -  l)'[&Ac(T,0)Qtmp(T)$Ac(T,0) 

-  [T &Ac(T,0)H(T)'H(T)$Ac(T,0)dT}x(i  -  1) 

J  0 

<  0,  by  inequality  (3.15).  (5.16) 

(Necessary  condition): 

Since  the  closed-loop  system  Ac(t)  is  asymptotically  stable  and  P(t)  is  positive 
definite,  the  inequality  (3.15)  follows  immediately  from  Propositions  5.1  and  5.2.  □ 

5.3  Theorem  3.1 

We  use  the  standard  completion  of  squares  method  while  accounting  for  the  possible 
jumps.  Differentiating  x'(t)P(t)x(t)  along  the  trajectory  of  system  (2.5),  we  obtain 

—x'Px  —  x'(t)P(t)x(t)  +  x'(t)P(t)x(t)  +  x'(t)P(t)x(t) 

=  x'{t)[A'P(t)  +  P(t)  +  P{t)A}x(t)  +  2<u,B'1Px> .  (5.17) 

Replace  term  [A'P(t)  +  P(t)  +  P(t)A]  by  equation  (3.1),  and  use  assumption  ii), 

jtx'Px  =  -a/(t)CiCix(t)  +  x,(t)P(t)R1BiP(t)a;(t)  +  2  <  u, B[Px  > 

=  ~\\z\\2  +  \\u  +  B[Px\\2.  (5.18) 

Integrating  equation  (5.18)  from  [iT,  (i  +  1)T]  for  some  i,  the  right-hand  side  (RHS) 
of  equation  (5.18)  becomes 

RHS  =  —  lkll[ir,(i+i)r]  +  llu  +  RiPx\%T,(i+i)T]-  (5.19) 
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where  the  left-hand  side  (LHS)  of  equation  (5.17)  becomes 


LHS  =  x'{iT+)P(iT+)x(iT+)-x\iT)P{iT)x(iT) 

=  [x(iT)  +  B2v0(i)]'  P(iT+)[x(iT)  +  B2v0(i)} 

- x'{iT)P{iT)x{iT ) 

=  v'0{i)B'2P(iT+)B2vo(i)  +  2  <  v0(i),B'2P{iT+)x(iT)  > 
+x{iT)[P(iT+)  -  P{iT)]x{iT) 

=  -72|M*)H2  +  ll(72^  +  B2P(iT+)B2)ll 2 

x[vo(»)  +  (72^  +  Bl2P(iT+)B2)~1  B2P(iT+)x(iT)]\\2 .  (5.20) 

Since  the  closed- loop  system  is  stable,  hence  x(t)  -»  0  as  t  — y  oo.  Assume  the  initial 
condition  rr(0)  =  0.  Integrate  above  equation  from  0  to  oo,  we  obtain  the  following 
equation, 

OO 

-72|MI?2  +  £  ||(72/  +  B2P(iT+)B2)1/2 

i=0 

X[v0(»)  +  (72/  +  ^P(iT+)S2)-1JB'P(iT+)rE(*T)]||2 

=  -Ml2  +  \\u  +  B[Px\\12.  (5.21) 

Taking  a  feedback  controller  u(t)  =  ~B[P(t)x(t)  and  since  the  summation  term  is 
always  nonnegative.  Thus  we  have  the  following  inequality 

I  Ml2  2  <  72|NI|2z-  (5-22) 

It  is  easy  to  see  from  (5.21)  that  the  worst  case  impulsive  disturbances  is 

v0(i)  =  -(72/  +  B'2P{kT+)B2)-lB'2P{iT+)x{iT).  (5.23) 

□ 


6  Conclusion 

In  this  paper,  we  have  given  a  complete  state-space  solution  to  the  (sub)optimal 
control  problem  of  a  class  of  linear  systems  suject  to  impulsive  disturbances.  The 
state  feedback  controller  can  be  computed  in  terms  of  the  unique  positive  definite 
periodic  solution  of  a  coupled  Riccati  equations.  The  procedure  to  compute  such  a 
feedback  controller  is  outlined  as  follows: 

1).  Given  7  >  0,  check  if  the  matrix  <&(T,  0)  has  no  eigenvalues  on  the  unit  circle. 
If  not,  increase  7  until  the  condition  is  satisfied. 
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2).  Compute  the  periodic  solution  P(t)  according  to  equations  (4.3),  (4.7)  and 
(4.10). 


3) .  Check  if  the  inequality  (3.15)  is  satisfied.  If  not,  go  back  to  step  1)  and  increase 
7  until  this  condition  is  satisfied. 

4) .  Compute  the  feedback  controller  u(t)  according  to  equation  (3.3). 

The  results  obtained  in  this  paper  can  be  extended  into  the  output  feedback  case, 
or  more  interestingly,  into  the  nonlinear  impact  control  problems  [2,  16]. 
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